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Summary. Exact analytic solutions and various numerical results for the rewiring of bipartite networks are 
discussed. An interpretation in terms of copying and innovation processes make this relevant in a wide variety of 
physical contexts. These include Urn models and Voter models, and our results are also relevant to some studies 
of Cultural Transmission, the Minority Game and some models of ecology. 

Introduction 

There are many situations where an 'individual' chooses only one of many 'artifacts' but where their 
choice depends in part on the current choices of the community. Names for new babies and registration 
rates of pedigree dogs often reflect current popular choices [TOIHT]. The allele for a particular gene carried 
('chosen') by an individual reflects current gene frequencies 0. In Urn models the probabilities controlling 
the urn chosen by a ball can reflect earlier choices [9]. In all cases copying the state of a neighbour, as 
defined by a network of the individuals, is a common process because it can be implemented without 
any global information [7 . At the other extreme, an individual might might pick an artifact at random. 

The Basic Model 

We first consider a non-growing bipartite network in which E 'individual' vertices are each attached by 
a single edge to one of N 'artifact' vertices. At each time step we choose to rewire the artifact end of one 
edge, the departure artifact chosen with probability Uf). This is attached to an arrival artifact chosen 
with probability Ua- Only after both choices are made is the graph rewired as shown in Fig. [TJ The 




N Artifacts 



Fig. 1. The bipartite network of E individual ver- 
tices, each connected by a single edge (solid lines) to 
any one of N artifacts. The dashed lines below the 
individuals are a social network. In the event shown 
individual 3 updates their choice, making B the de- 
parture artifact. They do this by copying the choice 
of a friend, friend of a friend, etc., found by making 
a random walk on the social network. Here this pro- 
duces A as the arrival artifact so edge 3B is rewired 
to become edge 3A. 
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degree distribution of the artifacts when averaged over many runs of this model, n(fc,i), satisfies the 
following equation:- 

n{k, t + 1) = n{k, t) + n{k + 1, <)i7i?(fc + 1, t) (1 - 7Ta(A: + 1, t)) 

-n{k, t)nR{k, t) (1 - nA{k, t)) - n{k, t)nA{k, t) (1 - iTK(fc, t)) 

+n(/c - l,t)77A(fc - (1 - 77fl(/c -!,<)) , {E>k>Q), (1) 

where n{k) — nR{k) — IlAik) ~ for k — —1, {E + 1). If 77/? or 77a have terms proportional to k^ then 
this equation is exact only when /3 = or 1 [S]. We will use the most general 77/? and 77^ for which ([T|) 
is exact, namely 

nR=^, nA=Pr^+Pp^, Pp+Pr = l {E>k>0). (2) 

This is equivalent to using a complete graph with self loops for the social network at this stage but these 
preferential attachment forms emerge naturally when using a random walk on a general network [7^ . This 
choice for 77^^ has two other special properties: one involves the scaling properties ^ and the second is that 
these exact equations can be solved analytically [3l[5l[6l|4]. The generating function G{z, t) = Ylk z''n{k, t) 
is decomposed into eigenmodes G^'"^(z) through G[z,t) — Y^m^QCm{)^myG^"^\z). From ^ we find a 
second order linear differential equation for each of the eigenmodes with solution [5^ 

G(™)(z) = (1 - z)"\Fi{a + m,-E + m;l- E - a(iV - 1); z) , a= , 

Pp N 

A™ = l-m(m-l)^-m^, 0<m<E, (3) 

where E' = E. These solutions are well known in theoretical population genetics as those of the Moran 
model [8] and one may map the bipartite model directly onto a simple model of the genetics of a haploid 
population [S]. 

The equilibrium result for the degree distribution [3l [5] is proportional to ^^^^r{E+i^k)^ ■ 

This has three typical regions. We have a condensate, where most of the edges are attached to one artifact 
p(k ^ E) ^ 0(iV"), for < + 1 - {k)y^ . On the other hand when > (1 + (fc))"^ we get a peak 
at small k with an exponential fall off, a distribution which becomes an exact binomial at = 1- In 
between we get a power law with an exponential cutoff, p{k) cx {k)~^ exp{— Cfc} where 7 w (1 — ^{k)) 
and C « — ln(l —pr)- For many parameter values the power 7 will be indistinguishable from one and 
this is a characteristic signal of an underlying copying mechanism seen in a diverse range of situations 
(e.g. see [ll[12]). 




Fig. 2. The equilibrium degree probability distri- 
bution function p{k) = n{k)/N toi N = E = 100. 
Shown are (from top to bottom at low k) pr — 1 (red 
crosses), 10/75 (green circles), 1/75 (blue stars) and 
0.1/75 (magenta squares). 



One of the best ways to study the evolution of the degree distribution [5l[^ is through the Homogeneity 
Measures, Fn- This is the probability that n distinct edges chosen at random are connected to same 
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artifact, and is given by F„(i) := {r{E + 1 - n)/r{E +l)){d''G{z, Further, each depends 

only on the modes numbered to n so they provide a practical way to fix the constants c„ in the mode 
expansion. Since Fq = E and Fi — 1, we find cq — I and ci = while equilibration occurs on a time 
scale oi T2 = — l/ln(A2). 
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Fig. 3. Plots of various Fn{t) for = iV = 100, 
Pr ~ 0.01. The points are averages over lO'' runs while 
the lines are the exact theoretical results. From top 
to bottom we have: F2{t) (crosses), F3{t) (circles), 
F4{t) (stars). 



Communities 

Our first generalisation of the basic model is to consider two distinct communities of individuals, say E^ 
(Ey) of type X (Y). The individuals of type X can now copy the choices made by their own community 
X with probability Ppxx, but a different rate is used when an X copies the choice made by somebody 
in community Y, Ppxy An X individual will then innovate with probability (1 — Ppxx — Ppxy)- Another 
two independent copying probabilities can be set for the Y community. At each time step we choose to 
update the choice of a member of community X (Y) community with probability Px {1 ~ Px)- Complete 
solutions are not available but one can find exact solutions for the lowest order Homogeneity measures 
and eigenvalues using similar techniques to those discussed above. The unilluminating details are given 
ini. 

Complex Social Networks 

An obvious generalisation is to use a complex network as the Individual's social network [6]. When 
copying, done with probability pp, an individual does a random walk on the social network to choose 
another individual and finally to copy their choice of artifact, as shown in Fig. [1] The random walk is 
an entirely local process, no global knowledge of the social network is needed, so it is likely to be a good 
approximation of many processes found in the real world. It also produces an attachment probability 
which is, to a good approximation, proportional to the degree distribution [7 . The alternative process 
of innovation, followed with probability pr, involves global knowledge through its normalisation N in 
However when N E this can represent innovation of new artifacts as it is likely that the arrival 
artifact has never been chosen before. However this process could also be a first approximation for other 
unknown processes used for artifact choice. 

Results shown in FigH] show that the existence of hubs in the Scale Free social network enhances the 
condensate while large distances in the social networks, as with the lattices, suppress the condensate. 

An interesting example is the case of = 2 which is a Voter Model [13] with noise (innovation 
Pr ^ 0) added. One can then compare the probability that a neighbour has a different artifact (the 
interface density) p{t), a local measure of the inhomogeneity, with our global measure (1 — F2{t)). These 
coincide when the social network is a complete graph. However as we move from 3D to ID lattices, 
keeping N, E and Pr constant, we see from Fig. [5] that both these local and global measures move away 
from the result for the complete graph but in opposite directions [6] . 
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Fig. 4. The degree distributions p{k) averaged over 
10* runs for different social networks of average de- 
gree of 4: Erdos-Reyni (red pluses), Exponential (ran- 
dom with p{k) oc exp(— ^fc), green circles), Scale Free 
(random with p{k) oc k~^, purple squares), periodic 
lattices of two (grey crosses) and one (blue diamonds) 
dimension. The line is the analytic result where the 
social network is a complete graph with self loops. 
N = 100, pr = 1/E. 
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Fig. 5. Inhomogeneity measures for various lattices 
against t/E. The black solid line represents the an- 
alytic result (1 - F2{t)) for iV = 2, = 1/E and 
E = 729. Numerical resuhs for (1 - F2{t)) (triangles) 
and for the average probability that a neighbour has 
a different artifact, rho{t) (circles) shown for social 
networks which are lattices of different dimensions. 
Averaged over 1000 runs. 



Different Update Methods 

Another way we can change the model is to change the nature of the update. Suppose we first select the 
edge to be rewired and immediately remove it. Then, based on this network of E' = (E — 1) edges, we 
choose the arrival artifact with probability Ua — (pr/N) + (1 — pr)k/E' . The original master equation 
^ is still valid and exact. Moreover it can still be solved exactly giving exactly the same form as before, 
but with E' = {E — 1) not E. This gives very small differences of order 0{E~^) when compared to 
the original simultaneous update used initially. 

Instead we will consider the simultaneous rewiring of X edges in our bipartite graph at each step. 
We will choose the individuals, whose edges define the departure artifacts, in one of two ways: either 
sequentially or at random. The arrival artifacts will be chosen as before using 11 a of 

The opposite extreme from the single edge rewiring case we started with (X = 1) is the one where 
all the edges are rewired at the same time, X — E. This is the model used in [101 El [2] to model various 
data sets on cultural transmission. It is also the classic Fisher- Wright model of population genetics 
[5]. From this each homogeneity measure Fn and the n-th eigenvector A„ may be calculated in terms 
of lower order results Fm (jn < n). Non trivial information again comes first from F2{t) = F2{oo) + 
(A2)*(F2(0) -^2(00)) where 

pl+jl-plm pliE-l) 



Comparing with the results for AT = 1 we see that there are large differences in the equilibrium solution 
and in the rate at which this is approached (measured in terms of number of the rewirings made). For 
intermediate values of X we have not obtained any analytical results so for these numerical simulations 
are needed, as shown in Figl6l 
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Fig. 6. r2 = — 1/ ln(A2) (left) and F2{oo) (right) obtained by fitting j4+i3(A2)* to the data for F2{t). For sequential 
(m = 4 black circles, lower lines) and random (m = 6 red triangles, upper lines) updates of X individuals at a 
time. N = E = 100, Pr ~ 1/E = 0.01 and averaged over lO'' runs. The dashed lines represent the best linear 
fit with T2 ~ 1230(20) + 21.8(3)X for m = 4 and T2 ^ 2470(10) + 8.1(2)X for m = 6. Theoretical values are 
T2 ~ 2512.1 and ^2(00) ^ 0.50251 for X = 1 random update and T2 ~ 3316.6 and ^2(00) ^ 0.33669 for X = 100 
either update. 
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Supplementary Material 



This following material is not part of the published paper. 

Fig[7] shows the basic model — simultaneous rewiring of the artifact end of a single edge. 



N Artifacts 




E Individuals 

Fig. 7. Each of E 'individual' vertices is connected by a single edge to one of A'^ 'artifact' vertices. In the simplest 
model the artifact end of one edge is rewired at each time step. The edge to be rewired is chosen with probability 
IIr (the edge from individual 3 to the departure artifact D) . At the same time the arrival artifact is chosen with 
probability Ua (here labelled A). The rewiring is performed only after both choices have been made. 

The evolution equation when X edges are rewired simultaneously, as shown in FiglSl is 

E 

G(z, t + £;) = ^ [1 + (z - l)nA{k')fn{k\ t) . (5) 

k'=0 




Fig. 8. An example of the rewiring of the bipartite graph. Here the choice made by each of the E — 7 'individual' 
vertices is represented by an edge connected to one of the N — 6 'artifact' vertices. At each time step X individuals 
decide to change their choice. Here X = 3 and the chosen individuals (3,5, and 6) and their edges are indicated 
by dashed lines in the left hand panel. The new artifacts for the X individuals are chosen with probability Ua- 
Here A is chosen twice and E once and the result is shown on the right. 



For the values used in Fig. i] and we would predict F2(X = 100; oo) = 0.3367 « (1/3) + 0(1/ E) 
while ^2(R.and, X = 1; oo) = 0.5025 « (1/2) + 0{1/E). These clearly match the numerical results shown 
in Fig. El and H 

Summary 

We have shown how simple models of bipartite network rewiring can be solved exactly. The preferential 
attachment can be seen as emerging from simple copying using local information only on the social 
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Fig. 9. F2 for sequential and random updates of X individuals at a time. N = E = 100, p,- — 1/E and averaged 
over 10^ runs. 



network. On the other hand the large N limit shows the random attachment process may be thought of 
as innovation. Many other models can be mapped to this simple network model — see the review in [5]. 
Thus copying and innovation may be enough to explain the results seen in many other contexts, such as 
the Minority game and in models of evolution ^12j . 



